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Despite the robustness of complex networks has been extensively studied in the last decade, there still lacks a 
unifying framework able to embrace all the proposed metrics. In the literature there are two open issues 
related to this gap: (a) how to dimension several metrics to allow their summation and (b) how to weight 
each of the metrics. In this work we propose a solution for the two aforementioned problems by defining the 
i?*-value and introducing the concept of robustness surface (Q). The rationale of our proposal is to make use 
of Principal Component Analysis (PCA). We firstly adjust to 1 the initial robustness of a network. Secondly, 
we find the most informative robustness metric under a specific failure scenario. Then, we repeat the process 
for several percentage of failures and different realizations of the failure process. Lastly, we Join these values 
to form the robustness surface, which allows the visual assessment of network robustness variabUity. Results 
show that a network presents different robustness surfaces (i.e., dissimilar shapes) depending on the failure 
scenario and the set of metrics. In addition, the robustness surface allows the robustness of different 
networks to be compared. 
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The study of complex networks has attracted significant attention in the past decade. Critical infrastructures 
such as power grids, telecommunication networks or transportation networks, among others, are complex 
networks which are omnipresent and play a pivotal role in ensuring the smooth functioning of modern day 
living. These networks have to constantly deal with failures of their components, hence, any disruption of the 
service provided might have a considerable impact upon sizable proportions of the world's inhabitants. Thus, 
understanding not only the structure, but also the dynamics of such networks is of paramount importance. 

Failures can be classified as being either random (i.e., accidental) or intentional (also referred to as targeted or 
deliberated)''^. Accidental failures occur as a result of random actions on network elements (e.g., human-made 
errors or natural disasters). In contrast, in intentional attacks components are chosen according to some criterion 
in order to maximize the impact of the failures (e.g., a Denial-of-Service (DoS) attack). We define a failure scenario 
as the pair given by a specific type of failure (e.g., node or link) and a given attack strategy (e.g., random or 
intentional). 

For network engineers and operators it is crucial to quantify the tolerance of a network to a given failure 
scenario. Robustness is defined as the ability of a network to maintain its total throughput under node or link 
removaP*. 

Robustness metrics have been evolving since the advent of network science. Initially, several works studied the 
robustness of complex networks by considering a single graph metric: efficiency\ average shortest-path length'"'', 
diameter*, clustering coefficient'"'', node and link connectivity'", heterogeneity", two-terminal reliability'"', assor- 
tativity", betweenness centrality'"', among others. Later on, new metrics were proposed in order to capture 
advanced characteristics (i.e., by means of spectral graph theory): symmetry ratio"", algebraic connectivity"" or 
spectral radius". Furthermore, other works presented more contemporary metrics which were based on classical 
graph features. For instance, the authors of studied the robustness in terms of flow diversity, a metric based on 
the shortest-path length. More recently, generic procedures to capture the robustness of a network for the whole 
spectrum of possible failures have been presented. Metrics such as elasticity^ or endurance'' quantify the robust- 
ness of a network according to a single throughput parameter. Trajanovski et al., have proposed a framework to 
evaluate the robustness of complex networks, which is based on the generic metric .R-value". From now on, we 
•will use the conventions defined in Table 1. According to^", the _R- value is denoted by: 



(1) 



where s and t are n X 1 weight and graph metric vectors, respectively, and n is the number of robustness metrics. 
Thus, the i^-value includes several graph metrics characterizing network robustness. However, there are two open 
issues related to the normalization of the t metrics: 
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failure configurations, i.e., different realizations of the 
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normalized eigenvector PC (size n X 1 ] 


P 


set of percentage of failures 


P 


percentage of failures (p ^ F) 




vector of metrics v/hen p% of elements fail 


«; 


R-value when p% of elements fail 




m X n matrix, i.e., m values for each of the n metrics when 




p% of elements fail 




vector of values (size m x 1 ) 


co'p 


vector (Or. sorted in decreasinq order 


Cp 


covariance matrix of Ap (size nX n) 


c 


average of the | P covariance matrices (size n X n) 


V 


matrix containing n eigenvectors v 


D 


diagonal matrix with eigenvalues (size n X n) 


1 


number of most relevant eigenvector 


n 


robustness surface, i.e., P vectors w'^ 



1. How to unify the dimensionality of each robustness metric of 
vector t in order to legitimate their summation. 

2. How to define the weight of each metric to optimally extract the 
most significant information. 

In this work we propose a solution for the two aforementioned 
problems by defining the i^* -value and introducing the concept of 
robustness surface (Q.). The former extracts the most informative 
robustness metric for a failure scenario, while the latter allows net- 
work robustness variations of different networks to be visually 
assessed, regardless of the failure scenario. 

Results 

i?*-value. The rationale of our proposal is to make use of Principal 
Component Analysis (PCA) (see Methods). Given a set of robustness 
metrics t, we first define the initial robustness as follows: 

n 

Rlu=Y.^ktl = l (2) 

k=l 

where f is the set of metrics when no failures occur, and v is a 
normalized eigenvector or Principal Component (PC). We obtain 
V from the procedure that computes the robustness surface (see 
following subsection and Eq. 4). The fact that v is normalized 
makes R*^-^ equal to 1. Additionally, _R* can be computed whenp% 
of elements fail as denoted next: 

K=Y.hK (3) 

k=l 

where is the set of metrics computed whenp% of failures occur. _R* 
takes values in the interval [0, 

The difference between _R* and _R (Eq. 1 ) is that in our proposal the 
principal component v gives dimension and non- arbitrary weights to 
each of the metrics. In addition, besides finding the most informative 
robustness metric, we adjust the initial robustness to 1, thus simpli- 
fying the comparison of network robustness variations when failures 
occur. 



Robustness surface (Q). The robustness surface allows the network 
performance variability for a given failure scenario to be visually 
assessed. 

In fact, n is a matrix where the rows are the percentage of failures 
(P) and the columns are the distinct failure configurations (m). The 
list of percentage of failures P (e.g., P = {1%, 2%.. 100%}) denotes the 
range of failures for which the robustness is evaluated. A failure 
configuration represents a realization of the failure process. The dif- 
ferent failure configurations m depict the different subsets of ele- 
ments that fail for a given percentage of failures, with each subset 
being distinct from one another. The robustness value in Q[p][!], 
where p e {1%..|P|%} and i e {l..m}, is given hy R* (Eq. 3). 

To obtain the robustness surface of a network given a failure 
scenario (e.g., node and random), we define the following procedure: 

1. Let Ap be an m X « matrix where p e {1%..|P|%} is the per- 
centage of failure. The goal is to transform Ap into a smaller 
data set, i.e., a vector ojp of size m, while preserving the most 
significant information. Therefore, we define cOp as a vector of 
size m X 1. cOp contains the set of m values _R* computed when 
p% of elements fail. 

2. To do so, we first compute the covariance matrix Cp of each 
matrix Ap. Then, we average the |P| covariance matrices to 
obtain a unique matrix C. This allows us to obtain a PC inde- 
pendent of p. 

3. We calculate the eigenvectors V and the eigenvalues D of C. At 
this point, the I most relevant eigenvectors of y are taken as the 
principal components for each matrix Ap (see Methods for 
further details). Hereafter we assume that / = 1, i.e., v is the 
eigenvector PC. 

4. Then, we obtain v by normalizing v: 

^;- y-/\o, ;e {!•■«} (4) 

5. By multiplying the principal component v by each row of Ap we 
obtain a vector cOp of size m. Each value of U3p is, indeed, i^*. 
Next, by iterating this procedure for all matrices Ap, we obtain a 
set of |P| vectors to p. Finally, we define co'p as a vector lOp sorted 
in decreasing order. Consequently, the robustness surface is 
given by the following expression Q = {aj'i%, . . . ,oj'|p|o^,}. 

Although different failure scenarios (e.g, link random and link by 
betweenness centrality) provide different v, each of them satisfies Eq. 
2 because v is normalized (as shown in Eq. 4). 

Case study. Here, we illustrate the suitability of our proposal for 
evaluating the robustness when considering several metrics. To do 
so, we study two real critical infrastructures: the Spanish railway 
network (sprailwayY^ and the European power grid network 
{europgy^. 

We consider incremental and irreversible random and targeted 
attacks (e.g., betweenness centrality (BC) or node degree). Link and 
node failures are considered for the sprailway and europg, respect- 
ively, to show that the robustness surface allows us to compare net- 
work robustness independently from the failure scenario. Link 
failures are caused randomly and by link BC, whereas node failures 
are caused randomly, by node degree, the clustering coefficient and 
node BC. In both cases, |P| is set to 70, i.e., from 1% to 70% of failures. 
The presented results are obtained for 500 and 100 runs (m) for 
random and targeted attacks, respectively. For each of the runs, a 
different realization of the failure process is considered, i.e., a distinct 
subset of elements that fail according to the failure scenario. 

We consider the following metrics: the largest connected compon- 
ent (LCC), the degree of fragmentation as a function of the number of 
connected components (only applicable to link failures), the average 
nodal degree, the two-terminal reliability, the average clustering 
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Table 2 | Main 
overage node 
assortativity (r) 


network 
degree 


characteristics. The table displays, from left to right, topology 
± standard deviation (StDev) ((k)), maximum degree (/tmax)/ 


name, number of nodes (N), number of links (/.), 
average shortest-path length ± StDev ({1}) and 


topology 




N L <<;)± StDev La. 


(1) ± StDev 


r 


sprailway 
europg 




169 190 2.24 ±1.09 8 
1,494 2,154 2.88 ±1.75 13 


10.49 ± 4.64 
18.88 ± 8.73 


-0.269 
-0.119 



coefficient, the average sliortest-patii lengtli, the diameter, the aver- 
age node BC, the average link BC and the algebraic connectivity. 
Therefore, link failures have n = 10 while node failures have n = 9. 

Table 2 presents the main characteristics of the two networks 
considered. Although both networks have a different number of 
nodes and links, they show a similar average node degree (fc), which 
is between 2 and 3. However, europg has a higher node maximum 
degree, what means that such a network is more vulnerable to tar- 
geted attacks. The average shortest-path length (Z) depicts that europg 
is about two times wider than sprailway. Finally, both networks have 
a negative value of assortativity (r), which means that nodes of dis- 
similar degrees are connected to each other. 

Numerical results. The results of our work are presented in Figures 1 
and 2. The x-axes show the different failure configurations for which 
the n metrics have been computed. The y-axes depict the range of 
percentage of failures (from 1% to 70%). At each coordinate (x,y), i.e., 
for each percentage of failures and for each subset of elements that 
fail, the i?*-value is shown. In each figure the range of colors expresses 
variability, with dark blue and dark red being the two extremes of 
each failure scenario intervals. Since iJ*,;, = 1, i.e., the initial 
robustness is set to 1 regardless of the set of n chosen metrics, our 
results allow a visual assessment of the robustness variation with 
respect to the initial conditions. The further the value of R* is with 
respect to R*„jt, the lower the performance of the network is. When R* 
is close to 0, the performance is considered to be totally deteriorated. 
Moreover, it is possible to observe K*p = l whenp s 1%, and the LCC 
of the network has similar properties to the initial network (without 
failures). 

Figure 1 presents the robustness surface Q. of sprailway in the case 
of random (a) and link BC failures (b). Interestingly, the random case 
provides a smooth surface, while the targeted case presents abrupt 
slopes. The latter is worth noting, because the presence of abrupt 



slopes in the robustness surface means that there are network ele- 
ments (in this case, links) that could be protected in order to improve 
the overall network robustness. 

In the case of europg. Fig. 2 depicts four robustness surfaces under 
different node failure scenarios. Similar to sprailway, the random 
surface in Fig. 2a depicts a regular behavior. In addition, the tar- 
geted-based cases depict rough surfaces. While Figs. 2b and 2c depict 
that europg is not robust under node degree or node BC failure 
scenarios. Fig. 2d shows that the network keeps the initial robustness 
until more than 30% of the nodes have failed. This implies that 
europg is significantly more robust under failures by the clustering 
coefficient than by other targeted strategies. 

For some failure configurations, it is worth noting that K* might 
increase at some percentage of failures with respect to i^*,,,, as 
observed in 10% or 20% of failures in Fig. la and in 20% or 30% in 
Fig. 2a, as well as in the targeted-based surfaces. This result should 
not be misleading because it totally depends on the set of metrics that 
are being considered for the study. For instance, while some metrics 
might decrease as the percentage of failures increases, others might 
alternate increments and decrements because they depend on the 
number and size of largest connected components (i.e., average 
shortest-path length, diameter, algebraic connectivity, etc.). There- 
fore, the suitability of the robustness surface remains intact, because 
the variability of the robustness can be assessed in any case. 

Finally, to compare the robustness surfaces of both networks, and 
considering the different failure scenarios, we average the values of 
each co'p of Q.. Thus, for each network and failure scenario, we obtain 
\P\ i^*-values. Fig. 3 depicts a summary of the results. Fig. 3a shows 
the curves of .R* of both networks from 1% to 70% of failures. To 
complement the results in Fig. 3a, the variance is presented in Fig. 3b. 
For instance, it can be observed that both random failure scenarios 
show similar behaviors, although for europg the top of the curve is 
around 24% of failures. Therefore, our approach allows us to com- 




50 100 150 200 250 300 350 400 450 
Failure configurations 

(a) sprail«'ay random 



10 20 30 40 50 60 70 80 90 
Failure configurations 

(b) sprailw ay link betweenness centrality 



Figure 1 | Robustness surface £2 of sprailway when causing links to fail randomly and by link BC. 
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(b) europg node bel%\'eenness centraiity 




30 40 50 60 70 
Failure configurations 




30 40 50 60 70 
Faiiure configurations 



(c) europg node degree (c) europg clustering coefficient 

Figure 2 | Robustness surface fl of europg when causing nodes to fail randomly, by node BC, by node degree and by the clustering coefficient. 



pare different networks, regardless of the failure scenarios. This com- 
parison could be done numerically, for instance, by comparing the 
areas below the curves. 

Discussion 

In this work we present the _R* -value and the concept of robustness 
surface (Q). The rationale of our proposal is to make use of Principal 
Component Analysis (PC A). 

The _R* -value solves two open issues in the robustness of com- 
plex networks field. Our proposal extracts the most significant 
information from a set of robustness metrics. R* is the first generic 
metric able to characterize the robustness of complex networks 
with a single value, while taking into account several robustness 
metrics. 

The robustness surface fl provides a framework to visually assess 
the network robustness variability. Moreover, it allows for the com- 
parison of the robustness between different networks under distinct 
failure scenarios. To the best of our knowledge, it is the first method 
of its kind to allow the visual evaluation of the network robustness for 
a specific failure scenario, while at the same time considering several 
robustness metrics. 



Robustness surfaces are designed as a visual monitoring tool. First, 
our approach is applicable to real-time monitoring of a network 
through a single value, when it is otherwise implemented according 
to multiplicity of correlated metrics with possible inherent redund- 
ancy. Second, fl can be a pivotal part of a network robustness refine- 
ment process: 

Step 1: If the robustness surface presents abrupt slopes, then there 
are network elements (nodes or links) which are weaker 
than the rest, for a given failure scenario. These elements 
could be identified by means of traditional robustness met- 
rics such as the betweenness centraiity. 

Step 2: Enhance or protect the weak elements, for instance, by 
adding new links or applying immunization techniques. 

Step 3: Re-evaluate the robustness of a network and, instead of 
comparing a large number of robustness metrics, detect 
through visual inspection if the network robustness has 
been improved. 

We believe that the contributions presented in this work will lay a 
firm foundation for future research on the robustness of complex 
networks. 
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30 40 
Percentage of failures 



30 40 
Percentage of failures 



(a) Mean R 



(b) Variance R 



Figure 3 | R* mean and variance of sprailway and europgunder the different failure scenarios. As to the legend, L refers to link failures, whereas N refers 
to nodes. 



To conclude, the -value shows that there is no single and uni- 
versal robustness metric for a network. Instead, the robustness varies 
according to the failure scenario and the metrics that are used to 
quantify the performance of the network. 

For future work, we plan to study the stability of the robustness 
surfaces with respect to network size scaling. 

Methods 

Principal Component Analysis (PCA). PCA is a powerful tool to identify the most 
significant information in a data table representing observations described by several 
dependent variables, which can be inherently correlated. The goals of the PCA are to: 
(a) extract the main information of a data set and express it by means of new 
orthogonal variables called principal components; and (b) compress the size of the 
data set while preserving the most important information^^. 

Let A be a data set of m observations of a vector-valued variable, i.e., A e R'"^". We 
define C as the covariance matrix of A, which is denoted by: 

^« X « ^ {c- .^a^. ^ cov(coIa^.coIa^ ) ) (5) 

where i,j e {L.tt}, and cov[coIa_.,coIa.') is the covariance function evaluating column i 
and column j. 

PCA works with the spectrum of C. Let v, G R"^-^{i e \..n] and El Rhe the 
eigenvectors and corresponding eigenvalues of the covariance matrix C, respectively. 
The matrix V with all v, as columns represents the principal components, and pro- 
vides an orthogonal transformation to the PC space. Furthermore, we denote D as a 
matrix with the eigenvalues in its diagonal. 

Let VhenXl matrix, which only contains the top / of the most important principal 
components (see Methods: Most relevant principal components of A for further 
details). Therefore, we can obtain the transformed data co — AV. 

In our problem, each failure has a covariance matrix Cp, wherep is the percentage of 
failure. We perform the PCA on C — CpSp, in order to obtain the PC independent of 
P- 

Most relevant principal components of A. In order to choose the / most relevant 
principal components, matrices V (eigenvectors) and D (eigenvalues) must be 
column-sorted in decreasing order, according to the eigenvalues in the diagonal of D. 
The importance of each eigenvector is characterized by its energy quantum g. The 
eigenvalues represent the distribution of the energy of A among each of the 
eigenvectors. The energy quantum for the eigenvector is the sum of the energy 
quantum across all eigenvalues from 1 to j: 

g[j] = im[k] j=l-n . (6) 

k = i 

Let be an tt X /, where / ^ n matrix that contains the most relevant eigenvectors. 
Then, the objective is to choose an / value as low as possible while preserving a 
reasonable high value of ^ on a percentage basis. For instance, we have chosen / so that 
g is above a certain threshold a: 



minllG [l..n] : ^ >al (7) 
I gm J 

In this work we have considered a — 0.9, from which we have obtained / — 1. 

Simulation details. The computation of each metric has been done with 
PHISON^^. The simulations were performed on a Linux system with a 16-core 64- 
bit Intel Xeon processor of 2 Ghz and 64 GB of RAM. The presented results are 
the average of 500 and 100 differently seeded simulation runs for random and 
targeted failures, respectively. The figures have been plotted by means of the 
pcolor function of MATLAB. In addition, the PCA has also been done with 
MATLAB. 



1. Albert, R., Jeong, H. & Barabasi, A. Error and attack tolerance of complex 
networks. Nature 406, 378-382 (2000). 

2. Manzano, M., Calle, E., Torres-Padrosa, V., Segovia, J. & Harle, D. Endurance: A 
new robustness measure for complex networks under multiple failure scenarios. 
Computer Netw. 57, 3641-3653 (2013). 

3. Sydney, A., Scoglio, C, Youssef, M. & Schumm, P. Characterising the robustness 
of complex networks. Int. J. Internet Technol. Secur. Syst. 2, 291-320 (2010). 

4. Manzano, M., Calle, E. & Harle, D. Quantitative and qualitative network 
robustness analysis under different multiple failure scenarios. In Proceedings of 
the 3rd International Workshop on Reliable Networks Design and Modeling 
(RNDM), 1-7 (2011). 

5. Latora, V. & Marchiori, M. Efficient behavior of small- world networks. Phys. Rev. 
Lett. 87, 198701 (2001). 

6. Watts, D. J. & Strogatz, S. H. Collective dynamics of 'small- world' networks. 
Nature 393, 440-442 (1998). 

7. Shannon, C. & Moore, D. The Spread of the Witty Worm. IEEE Secur. Priv. 2, 
46-50 (2004). 

8. Albert, R., Jeong, H. & Barabasi, A. Internet: Diameter of the world-wide web. 
Nature 401, 130-131 (1999). 

9. Bollobas, B. Mathematical results on scale-free random graphs. In Handbook of 
Graphs and Networks, 1-34 (Wiley- VCH, 2003). 

10. Dekker, A. H. & Colbert, B. D. Network robustness and graph topology. In 
Proceedings of the 27th Australasian conference on Computer science - Volume 26, 
ACSC, Australian Computer Society, 359-368 (2004). 

11. Dong, J. & Horvath, S. Understanding network concepts in modules. BMC Syst. 
Biol. 1, 1-24 (2007). 

12. Neumayer, S. & Modiano, E. Network reliability with geographically correlated 
failures. In Proceedings of the 29th conference on Information Communications 
(INFOCOM), 1658-1666 (2010). 

13. Mahadevan, P. et al. The internet AS-level topology: three data sources and one 
defmitive metric. SIGCOMM Comput. Commun. Rev. 36, 17-26 (2006). 

14. Freeman, L. C. A set of measures of centrality based upon betweenness. Sociometry 
40, 35-41 (1977). 

15. Dekker, A. H. & Colbert, B. D. The symmetry ratio of a network. In Proceedings of 
the 2005 Australasian symposium on Theory of computing - Volume 41, CATS, 
Australian Computer Society, 13-20 (2005). 



SCIENTIFIC REPORTS | 4:6133 | DO!: 1 0. 1 038/srep061 33 



5 



16. Jamakovic, A. & Mieghem, P. V. On the Robustness of Complex Networks by 
Using the Algebraic Connectivity. In Proceedings of Networking, vol. 4982, 
183-194 (2008). 

17. Van Mieghem, P., Omic, J. & Kooij, R. Virus Spread in Networks. IEEE/ACM 
Trans. Netw. 17, 1-14 (2009). 

18. Rohrer, J. P. & Sterbenz, J. P. G. Predicting Topology Survivability usmg Path 
Diversity. In Proceedings of the 3rd International Workshop on Reliable Networks 
Design and Modeling (RNDM), 1-7 (2011). 

19. Trajanovski, S., Martin- Hernandez, J., Winterbach, W. & Van Mieghem, P. 
Robustness envelopes of networks. /. Complex Netw. 1, 44-62 (2013). 

20. Van Mieghem, P. et at. A framework for computing topological network 
robustness. Technical Report 20101218, Networks Architectures and Services, Delft 
University of Technology (2010). 

21. Roanes-Lozano, E. et al. Evolution of railway network flexibility: The Spanish 
broad gauge case. Math. Comput. Simul. 79, 2317-2332 (2009). 

22. Hutcheon, N. & Bialek, J. W. Updated and validated power flow model of the main 
continental european transmission network. In Proceedings of the IEEE 
PowerTech 2013 (2013). 

23. Abdi, H. & Williams, L. J. Principal component analysis. Computation. Stat. 2, 
433-459 (2010). 

24. Manzano, M., Segovia, J., Calle, E. & Marzo, J. L. PRISON: Playground for High- 
level Simulations On Networks. In Proceedings of the 2012 International 
Symposium on Performance Evaluation of Computer and Telecommunication 
Systems (SPECTS) (2012). 



Acknowledgment's 



This work is partially supported by the Spanish Ministry of Science and Innovation project 
TEC 2012-32336, and by the Generalitat de Catalunya research support program 
SGR-1202. This work is also partially supported by the Secretariat for Universities and 
Research (SUR) and the Ministry of Economy and Knowledge through AGAUR Fl-DGR 
2012 and BE-DGR 2012 grants. Marc Manzano carried out this work while visiting the 
EPICENTER research group at Kansas State University, USA. 

Author contributions 

M.M. carried out the numerical experiments. M.M. and F.S. defined the two contributions 
of the manuscript. M.M., C.S. and J.L.M. prepared the figures. M.M., F.S., C.S., E.G. and 
J.L.M. wrote and reviewed the manuscript. 

Additional information 

Competing financial interests: The authors declare no competing financial interests. 

How to cite this article: Manzano, M., Sahneh, F., Scoglio, C, Calle, E. &c Marzo, J.L. 
Robustness surfaces of complex networks. Sci. Rep. 4, 6133; DOl:10.103S/srep06133 (2014). 

I This work is licensed under a Creative Commons Attribution-NonCommercial- 
NoDerivs 4.0 Intemational License. The images or other third party material in 
this article are included in the article's Creative Commons license, unless indicated 
otherwise in the credit Hne; if the material is not included under the Creative 
Commons license, users will need to obtain permission from the license holder 
in order to reproduce the material. To view a copy of this license, visit http:// 
creativecommons.org/hcenses/by-nc-nd/4.0/ 



SCIENTIFIC REPORTS | 4:6133 | DOI: 10.1038/srep06133 



6 



